Face and skin sensitive image enhancement

ABSTRACT

Systems and methods of face and skin sensitive image enhancement are disclosed. In one aspect, a face map that includes for each pixel of an input image a respective face probability value indicating a degree to which the pixel corresponds to a human face is calculated. A skin map that includes for each pixel of the input image a respective skin probability value indicating a degree to which the pixel corresponds to human skin is ascertained. The input image is enhanced with an enhancement level that varies pixel-by-pixel in accordance with the respective face probability values and the respective skin probability values. In another aspect, a facial content measurement value indicating a degree to which an input image contains human face content is ascertained. A tone-correction process is tuned in accordance with the facial content measurement value. The input image is enhanced in accordance with the tuned tone-correction process.

BACKGROUND

Image enhancement involves one or more processes that are designed toimprove the visual appearance of an image. Typical image enhancementprocesses include sharpening, noise reduction, scene balancing, andtone-correction.

Global or otherwise unguided application of image enhancement processestypically does not produce satisfactory results because the enhancementsthat are desired by most observers of an image typically vary with imagecontent. For example, it generally is desirable to sharpen imagecontent, such as trees, grass, and other objects containing interestingtexture, edge or boundary features, but it is undesirable to sharpencertain features of human faces (e.g., wrinkles and blemishes).Conversely, it typically is desirable to smooth wrinkles and blemisheson human faces, but it is undesirable to smooth other types of imagecontent, such as trees, grass, and other objects containing interestingtexture, edge or boundary features.

In an effort to avoid the undesirable effects of global or unguidedimage enhancement, various manual image enhancement approaches have beendeveloped to enable selective application of image enhancement processesto various image content regions in an image. Some of these approachesrely on manual selection of the image content regions and the desiredimage enhancement process: Most manual image enhancement systems of thistype, however, require a substantial investment of money, time, andeffort before they can be used to manually enhance images. Even after auser has become proficient at using a manual image enhancement system,the process of enhancing images is typically time-consuming andlabor-intensive.

Automatic image enhancement approaches for avoiding the undesirableeffects of global or unguided image enhancement also have beendeveloped. Some of these approaches automatically create maps of localattributes such as noise or sharpness estimations, and gain localcontrol over enhancement parameters based on those maps. Otherapproaches typically rely on automatic region-based image enhancement.In accordance with one automatic region-based image enhancementapproach, the amount of image enhancement is determined automaticallyfor each region in an image based on the subject matter content in theregion. In this process, a respective probability distribution iscomputed for each type of targeted subject matter content across theimage. Each probability distribution indicates for each pixel theprobability that the pixel belongs to the target subject matter. Eachprobability distribution is thresholded to identify candidate subjectmatter regions. Each of the candidate subject matter regions issubjected to a unique characteristics analysis that determines theprobability that the region belongs to the target subject matter. Theunique characteristics analysis process generates a belief map ofdetected target subject matter regions and assigns to each of thedetected regions an associated probability indicating the probabilitythat the region belongs to the target subject matter. A given belief maponly relates to one type of subject matter and the pixels in any givenone of the detected subject matter regions in a belief map are assignedthe same probability value. Since region detection, as good as it maybe, is prone to some errors, the probability discontinuities between thedetected subject matter regions and other regions in each belief mapnecessarily produce artifacts in the resulting enhanced image. Forexample, if a face region is detected and enhanced using a parameterthat is different from the parameter used for the rest of the body,artifacts will most probably be created in border regions. In addition,reality does not always support subject matter regions but rather acontinuous change from region to region. This is most evident and mostimportant in terms of avoiding artifacts for image sub-regions requiringdrastically different enhancement types, for example, it typically isdesirable to smooth facial skin areas and sharpen facial features, suchas eyes and lips.

What are needed are image enhancement approaches that avoid artifactsand other undesirable problems that arise as a result of enhancing animage based on segmentations of the image into discrete subject matterregions. Image enhancement systems and methods that are capable ofenhancing images in face and skin sensitive ways also are needed.

SUMMARY

In one aspect, the invention features a method in accordance with whicha face map is calculated. The face map includes for each pixel of aninput image a respective face probability value indicating a degree towhich the pixel corresponds to a human face, where variations in theface probability values are continuous across the face map. A skin mapis ascertained. The skin map includes for each pixel of the input imagea respective skin probability value indicating a degree to which thepixel corresponds to human skin. The process of ascertaining the skinmap includes mapping all pixels of the input image having similar valuesto similar respective skin probability values in the skin map. The inputimage is enhanced with an enhancement level that varies pixel-by-pixelin accordance with the respective face probability values and therespective skin probability values.

In another aspect, the invention features a method in accordance withwhich a facial content measurement value indicating a degree to which aninput image contains human face content is ascertained. Atone-correction process is tuned in accordance with the facial contentmeasurement value. The input image is enhanced in accordance with thetuned tone-correction process.

The invention also features apparatus and machine readable media storingmachine-readable instructions causing a machine to implement the methodsdescribed above.

Other features and advantages of the invention will become apparent fromthe following description, including the drawings and the claims.

DESCRIPTION OF DRAWINGS

FIG. 1 is a block diagram of an embodiment of an image enhancementsystem.

FIG. 2 is a flow diagram of an embodiment of an image enhancementmethod.

FIG. 3 is an example of an input image.

FIG. 4 is a block diagram of an embodiment of the face map module shownin FIG. 1.

FIG. 5 is a block diagram of an embodiment of a single classificationstage in an implementation of the face map module shown in FIG. 4 thatis designed to evaluate candidate face patches in an image.

FIG. 6 is a graphical representation of an example of a face mapgenerated by the face map module of FIG. 4 from the input image shown inFIG. 3.

FIGS. 7A, 7B, and 7C show exemplary graphs of human skin toneprobabilities for respective channels of the CIE LCH color space.

FIG. 8 is a graphical representation of an example of a skin mapgenerated by the skin map module shown in FIG. 1 from the input imageshown in FIG. 3.

FIG. 9 is a flow diagram of an embodiment of a method by which thecontrol parameter module shown in FIG. 1 generates control parametervalues for enhancing the input image of FIG. 1.

FIG. 10 is a graphical representation of an example of a sharpeningfactor map generated by the control parameter module shown in FIG. 1from the face map of FIG. 6 and the skin map of FIG. 8 in accordancewith the method of FIG. 9.

FIG. 11 is a block diagram of an embodiment of the image enhancementsystem of FIG. 1.

FIG. 12 is a flow diagram of an embodiment of an image enhancementmethod.

FIG. 13 is a block diagram of an embodiment of a computer system that isprogrammable to implement an embodiment of the image enhancement systemshown in FIG. 1.

DETAILED DESCRIPTION

In the following description, like reference numbers are used toidentify like elements. Furthermore, the drawings are intended toillustrate major features of exemplary embodiments in a diagrammaticmanner. The drawings are not intended to depict every feature of actualembodiments nor relative dimensions of the depicted elements, and arenot drawn to scale. Elements shown with dashed lines are optionalelements in the illustrated embodiments incorporating such elements.

I. Introduction

The embodiments that are described in detail below are capable ofenhancing images in face and skin sensitive ways.

At least some of the embodiments that are described in detail belowenhance images in ways that avoid artifacts and other undesirableproblems that arise as a result of enhancing an image based onsegmentations of the image into discrete subject matter regions. Theseembodiments leverage the inherent fuzziness of pixel-wise face and skinprobability maps to implement face and skin sensitive enhancements to animage in a flexible way that more accurately coincides with a typicalobserver's expectations of the image enhancements that should be appliedto different contents of the image.

At least some of the embodiments that are described in detail below arecapable of adjusting default control parameters in image-dependent ways.In some of these embodiments, for example, a global contrast enhancementprocess is tuned in accordance with a determination of the degree towhich an image contains human face content in order to achieve automaticface-sensitive enhancement of the image. These embodiments are capableof providing image-dependent enhancements within the framework ofexisting enhancement processes and, therefore, can be incorporatedreadily into existing image enhancement systems and processes.

II. A First Exemplary Image Enhancement System Embodiment

A. Overview

FIG. 1 shows an embodiment of an image enhancement system 10 thatincludes a set 12 of attribute extraction modules, including a face mapmodule 14, a skin map module 16, and possibly one or more otherattribute extraction modules 18. The image enhancement system 10 alsoincludes a control parameter module 20 and an image enhancement module22. In operation, the image enhancement system 10 performs one or moreimage enhancement operations on an input image 24 to produce an enhancedimage 26. In the process of enhancing the input image 24, the attributeextraction modules 14-18 determine respective measurement values 28based on values of pixels of the input image 24 (e.g., directly from thevalues of the input image 24 or from pixel values derived from the inputimage 24). The control parameter module 20 processes the measurementvalues 28 to produce control parameter values 30, which are used by theimage enhancement module 22 to produce the enhanced image 26 from theinput image 24.

The input image 24 may correspond to any type of digital image,including an original image (e.g., a video frame, a still image, or ascanned image) that was captured by an image sensor (e.g., a digitalvideo camera, a digital still image camera, or an optical scanner) or aprocessed (e.g., sub-sampled, filtered, reformatted, scene-balanced orotherwise enhanced or modified) version of such an original image. Insome embodiments, the input image 24 is an original full-sized image,the attribute extraction modules 12 process a sub sampled version of theoriginal full-sized image, and the image enhancement module 22 processesis the original full image 24.

FIG. 2 shows an embodiment of a method that is implemented by the imageprocessing system 10.

In accordance with the method of FIG. 2, the face map module 14calculates a face map that includes for each pixel of the input image 24a respective face probability value indicating a degree to which thepixel corresponds to a human face (FIG. 2, block 34). As explained indetail below, variations in the face probability values are continuousacross the face map. Thus, the values of neighboring face map pixels aresimilar. This approach avoids the artifacts and other discontinuitiesthat otherwise might result from a segmentation of the input image 24into discrete facial regions and non-facial regions.

The skin map module 16 ascertains a skin map that includes for eachpixel of the input image a respective skin probability value indicatinga degree to which the pixel corresponds to human skin (FIG. 2, block36). In this process, the skin map module 16 maps all pixels of theinput image 24 having similar values to similar respective skinprobability values in the skin map. This approach avoids both (i) theartifacts and other discontinuities that otherwise might result from asegmentation of the input image 24 into discrete human-skin tonedregions and non-human-skin toned regions, and (ii) artifacts and otherdiscontinuities that otherwise might result from undetected faces orpartly detected faces.

It is noted that the order in which the face map module 14 and the skinmap module 16 determine the face map and the skin map is immaterial. Insome embodiments, the face map module 14 determines the face map beforethe skin map module 16 determines the skin map. In other embodiments,the skin map module 16 determines the skin map before the face mapmodule 14 determines the face map. In still other embodiments, the facemap module 14 and the skin map module 16 determine the face map and theskin map in parallel.

The control parameter module 20 and the image enhancement module 22cooperatively enhance the input image 24 with an enhancement level thatvaries pixel-by-pixel in accordance with the respective face probabilityvalues and the respective skin probability values (FIG. 2, block 38).The measurement values 28 that are generated by the attribute extractionmodules 14-18 are permitted to vary continuously from pixel-to-pixelacross the image. This feature allows the control parameter module 20 toflexibly produce the control parameter values 30 in ways that moreaccurately coincide with a typical observer's expectations of the imageenhancements that should be applied to different contents of the image.In this way, the image enhancement module 22 can enhance the input image24 with an enhancement level that is both face and skin sensitive.

FIG. 3 shows an example 32 of the input image 24 that contains two humanfaces. In the following detailed description, the exemplary image 32 andthe various image data derived therefrom are used for illustrativepurposes only to explain one or more aspects of one or more embodimentsof the invention. In some embodiments, the control parameter module 20produces control parameter values 30 that selectively sharpennon-human-skin toned areas of the input image 32 more than human-skintoned areas and that selectively sharpen human-skin toned areas outsideof human faces more than human-skin toned areas inside human faces.Thus, in accordance with a typical observer's desired results,non-human-skin toned features (e.g., eyes, lips, hairline, trees, andgrass) inside and outside human faces can be sharpened aggressively,human-skin toned features (e.g., autumn leaves and dry grass) outside ofhuman faces can be sharpened less aggressively, and human-skin tonedfeatures within human faces can be sharpened still less aggressively ornot at all.

B. Calculating Face Maps

1. Overview

As explained above, the face map module 14 calculates a face map thatincludes for each pixel of the input image 24 a respective faceprobability value indicating a degree to which the pixel corresponds toa human face (FIG. 2, block 34). A characteristic feature of the facemap is that the variations in the face probability values are continuousacross the face map. As used herein, the term “continuous” means havingthe property that the absolute value of the numerical difference betweenthe value at a given point and the value at any point in a neighborhoodof the given point can be made as close to zero as desired by choosingthe neighborhood small enough.

In general, the face map module 14 may calculate the face probabilityvalues indicating the degrees to which the input image pixels correspondto human face content in a wide variety of different ways, including butnot limited to template-matching techniques, normalized correlationtechniques, and eigenspace decomposition techniques. In someembodiments, the face map module 14 initially calculates theprobabilities that patches (i.e., areas of pixels) of the input image 24correspond to a human face and then calculates a pixel-wise face mapfrom the patch probabilities (e.g., by assigning to each pixel thehighest probability of any patch that contains the pixel).

The embodiments that are described in detail below include a facedetection module that rejects patches part-way through an image patchevaluation process in which the population of patches classified as“faces” are progressively more and more likely to correspond to facialareas of the input image as the evaluation continues. The faceprobability generator 44 uses the exit point of the evaluation processas a measure of certainty that a patch is a face.

2. Single-View Based Face Map Generation

FIG. 4 shows an embodiment 40 of the face map module 14 that includes acascade 42 of classification stages (C₁, C₂, . . . , C_(n), where n hasan integer value greater than 1) (also referred to herein as“classifiers”) and a face probability generator 44. In operation, eachof the classification stages performs a binary discrimination functionthat classifies a patch 46 that is derived from the input image 24 intoa face class (“Yes”) or a non-face class (“No”) based on adiscrimination measure that is computed from one or more attributes ofthe image patch 44. The discrimination function of each classificationstage typically is designed to detect faces in a single pose or facialview (e.g., frontal upright faces). Depending on the evaluation resultsproduced by the cascade 42, the face probability generator 44 assigns arespective face probability value to each pixel of the input image 24and stores the assigned face probability value in a face map 48.

Each classification stage C_(i) of the cascade 42 has a respectiveclassification boundary that is controlled by a respective thresholdt_(i), where i=1, . . . , n. The value of the computed discriminationmeasure relative to the corresponding threshold determines the classinto which the image patch 46 will be classified by each classificationstage. For example, if the discrimination measure that is computed forthe image patch 46 is above the threshold for a classification stage,the image patch 46 is classified into the face class (Yes) whereas, ifthe computed discrimination measure is below the threshold, the imagepatch 46 is classified into the non-face class (No).

FIG. 5 shows an exemplary embodiment of a single classification stage 50in an embodiment of the classifier cascade 42. In this embodiment, theimage patch 46 is projected into a feature space in accordance with aset of feature definitions 52. The image patch 46 includes anyinformation relating to an area of an input image, including colorvalues of input image pixels and other information derived from theinput image needed to compute feature weights. Each feature is definedby a rule that describes how to compute or measure a respective weight(w₀, w₁, . . . , w_(L)) for an image patch that corresponds to thecontribution of the feature to the representation of the image patch inthe feature space spanned by the set of features 52. The set of weights(w₀, w₁, . . . , w_(L)) that is computed for an image patch constitutesa feature vector 54. The feature vector 54 is input into theclassification stage 50. The classification stage 50 classifies theimage patch 46 into a set 56 of candidate face areas or a set 58 ofnon-faces. If the image patch is classification as a face, it is passedto the next classification stage, which implements a differentdiscrimination function.

In some implementations, the classification stage 50 implements adiscrimination function that is defined in equation (1):

$\begin{matrix}{{\sum\limits_{\ell = 1}^{L}{g_{\ell}{h_{\ell}(u)}}} > 0} & (1)\end{matrix}$where u contains values corresponding to the image patch 46 and g_(l)are weights that the classification stage 50 applies to thecorresponding threshold function h_(l)(u), which is defined by:

$\begin{matrix}{{h_{\ell}(u)} = \left\{ \begin{matrix}{1,} & {{{if}\mspace{14mu} p_{\ell}{w_{\ell}(u)}} > {p_{\ell}t_{\ell}}} \\{0,} & {otherwise}\end{matrix} \right.} & (2)\end{matrix}$The variable p_(l) has a value of +1 or −1 and the function w(u) is anevaluation function for computing the features of the feature vector 54.

Additional details regarding the construction and operation of theclassifier cascade 42 can be obtained from U.S. Pat. No. 7,099,510.

In summary, the classifier cascade 42 processes the patches 46 of theinput image 24 through the classification stages (C₁, C₂, . . . ,C_(n)), where each image patch is processed through a respective numberof the classification stages depending on a per-classifier evaluation ofthe likelihood that the patch corresponds to human face content.

The face probability generator 44 calculates the probabilities that thepatches 46 of the input image 24 correspond to human face content (i.e.,the face probability values) in accordance with the respective numbersof classifiers through which corresponding ones of the patches wereprocessed. For example, in one exemplary embodiment, the faceprobability generator 44 maps the number of unevaluated stages to arespective face probability value, where large numbers are mapped to lowprobability values and small numbers are mapped to high probabilityvalues. The face probability generator 44 calculates the pixel-wise facemap 48 from the patch probabilities (e.g., by assigning to each pixelthe highest probability of any patch that contains the pixel).

The pixel-wise face probability values typically are processed to ensurethat variations in the face probability values are continuous across theface map. In some embodiments, the face probability values in eachdetected face are smoothly reduced down to zero as the distance from thecenter of the detected face increases. In some of these embodiments, theface probability of any pixel is given by the original face probabilityvalue multiplied by a smooth monotonically decreasing function of thedistance from the center of the face, where the function has a value ofone at the face center and value of zero a specified distance from theface center. In one exemplary embodiment, a respective line segmentthrough the center of each of the detected faces and oriented accordingto the in-plane rotation of the detected face is determined. Theprobability attached to any pixel in a given one of the detected faceregions surrounding the respective line segment is then given by theface probability value multiplied by a clipped Gaussian function of thedistance from that pixel to the respective line segment. The clippedGaussian function has values of one on the respective line segment andon a small oval region around the respective line segment; in otherregions of the detected face, the values of the clipped Gaussianfunction decays to zero as the distance from the respective line segmentincreases.

3. Multi-View Based Face Map Generation

In some embodiments, each of the image patches 46 is passed through atleast two parallel classifier cascades that are configured to evaluatedifferent respective facial views. Some of these embodiments areimplemented in accordance with one or more of the multi-view facedetection methods described in Jones and Viola, “Fast Multi-view FaceDetection,” Mitsubishi Electric Research Laboratories, MERL-TR2003-96,July 2003 (also published in IEEE Conference on Computer Vision andPattern Recognition, Jun. 18, 2003).

In these embodiments, the face probability generator 44 determines theface probability values from the respective numbers of classifiers ofeach cascade through which corresponding ones of the patches wereevaluated. For example, in one exemplary embodiment, the faceprobability generator 44 maps the number of unevaluated classificationstages in the most successful one of the parallel classifier cascades,where large numbers are mapped to low probability values and smallnumbers are mapped to high probability values. In some embodiments, theclassifier cascade with the fewest number of unevaluated stages for thegiven patch is selected as the most successful classifier cascade. Inother embodiments, the numbers of unevaluated stages in the parallelstages are normalized for each view before comparing them. The faceprobability generator 44 calculates the pixel-wise face map 48 from thepatch probabilities (e.g., by assigning to each pixel the highestprobability of any patch that contains the pixel). The pixel-wise faceprobability values typically are processed in the manner described inthe preceding section to ensure that variations in the face probabilityvalues are continuous across the face map. In the resulting face map,face patches have a smooth (e.g. Gaussian) profile descending smoothlyfrom the nominal patch value to the nominal background value across alarge number of pixels.

FIG. 6 shows an example of a face map 60 that is generated by the facemap module 14 (FIG. 1) from the input image 32 (FIG. 3) in accordancewith the multi-view based face map generation process described above.In this face map 60, darker values correspond to higher probabilitiesthat the pixels correspond to human face content and lighter valuescorrespond to lower probabilities that the pixels correspond to humanface content.

C. Ascertaining Skin Maps

As explained above, the skin map module 16 ascertains a skin map thatincludes for each pixel of the input image a respective skin probabilityvalue indicating a degree to which the pixel corresponds to human skin(FIG. 2, block 36). A characteristic feature of the skin map is that allpixels of the input image 24 having similar values are mapped to similarrespective skin probability values in the skin map. As used herein withrespect to pixel values, the term “similar” means that the pixel valuesare the same or nearly the same and appear visually indistinguishablefrom one another. This feature of the skin map is important in, forexample, pixels of certain human-skin image patches that have colorsoutside of the standard human-skin tone range. This may happen, forexample, in shaded face-patches or alternatively in face highlights,where skin segments may sometimes have a false boundary between skin andnon skin regions. The skin map values vary continuously withoutartificial boundaries even in skin patches trailing far away from thestandard human-skin tone range.

In general, the skin map module 16 may ascertain the skin probabilityvalues indicating the degrees to which the input image pixels correspondto human skin in a wide variety of different ways. In a typicalapproach, the skin map module 16 ascertains the per-pixel human-skinprobability values from human-skin tone probability distributions inrespective channels of a color space. For example, in some embodiments,the skin map module 16 ascertains the per-pixel human-skin toneprobability values from human-skin tone probability distributions in theCIE LCH color space (i.e., P(skin|L), P(skin|C), and P(skin|H)). Thesehuman-skin tone probability distributions are approximated by Gaussiannormal distributions (i.e., G(p,μ,σ)) that are obtained from mean (μ)and standard deviation (σ) values for each of the p=L, C, and H colorchannels. In some embodiments, the mean (μ) and standard deviation (σ)values for each of the p=L, C, and H color channels are obtained from O.Martinez Bailac, “Semantic retrieval of memory color content”, PhDThesis, University Autonoma de Barcelona, 2004. Exemplary human-skintone probability distributions for the L, C, and H color channels areshown in FIGS. 7A, 7B, and 7C, respectively.

The skin map module 16 ascertains a respective skin probability valuefor each pixel of the input image 24 by converting the input image 24into the CIE LCH color space (if necessary), determining the respectiveskin-tone probability value for each of the L, C, and H color channelsbased on the corresponding human-skin tone probability distributions,and computing the product of the color channel probabilities, as shownin equation (3):P(skin|L,C,H)≈G(L, μ _(L), σ_(L))×G(C, μ _(C), σ_(C))×G(H, μ _(H),σ_(H))  (3)

In some embodiments, the skin map values are computed by applying to theprobability function P(skin |L,C,H) a range adaptation function thatprovides a clearer distinction between skin and non-skin pixels. In someof these embodiments, the range adaptation function is a power functionof the type defined in equation (4):M _(SKIN)(x, y)=P(skin|L(i), C(i), H(i))^(1/γ)  (4)where γ>0 and M_(SKIN)(x, y) are the skin map 62 values at location (x,y). In one exemplary embodiment, γ=32. The skin map function defined inequation (4) attaches high probabilities to a large spectrum of skintones, while non-skin features typically attain lower probabilities.

FIG. 8 shows an example of a skin map that is generated by the skin mapmodule 16 (FIG. 1) from the input image 32 (FIG. 3) in accordance withthe skin map generation process described in connection with equations(3) and (4). In this skin map 62, darker values correspond to lowerprobabilities that the pixels correspond to human skin content andlighter values correspond to higher probabilities that the pixelscorrespond to human skin content. As shown by a comparison of FIGS. 3and 8, the skin map 62 distinguishes the pixels of the input image 32depicting skin from the pixels depicting the pearls and the lace; andwithin the faces appearing in the input image 32, the skin map 62distinguishes skin from non-skin features (e.g., the eyes and lips).

D. Enhancing the Input Image

As explained above, the control parameter module 20 and the imageenhancement module 22 cooperatively enhance the input image 24 with anenhancement level that varies pixel-by-pixel in accordance with therespective face probability values and the respective skin probabilityvalues (FIG. 2, block 38). In this process, the control parameter module20 produces control parameter values 30 from the measurement values 28that are output by the attribute extraction modules 14-18. The imageenhancement module 22 produces the enhanced image 26 by performing onthe input image 24 one or more image processing operations that arecontrolled by the control parameter values 30.

In general, the control parameter module 20 and the image enhancementmodule 22 may be configured to perform a wide variety of face and skinsensitive enhancements on the input image 24. The embodiments that aredescribed in detail below, for example, are configured to perform faceand skin sensitive sharpening of the input image 24 and face-sensitivecontrast enhancement of the input image.

In some embodiments, the control parameter module 20 determines a globalcontrol parameter value based on global features of the input image 24.The control parameter module 20 then determines for each pixel of theinput image 24 a respective local control parameter value thatcorresponds to a respective modification of the global parameter valuein accordance with the respective face probability values and therespective skin probability values. The image enhancement module 22enhances the input image 24 in accordance with the local controlparameter values.

1. Sharpening the Input Image

The embodiments of the control parameter module 20 and the imageenhancement module 22 that are described in detail below are configuredto sharpen the input image 24 with a sharpening level that variespixel-by-pixel in accordance with the respective face probability valuesin the face map and the respective skin probability values in the skinmap. In some embodiments, the control parameter module 20 computes foreach pixel of the input image a respective sharpening parameter valuethat controls the amount of sharpening that is applied to the pixel.

The sharpening parameter values that are computed by the controlparameter module 20 are configured to cause the image enhancement module22 to sharpen the input image 24 with sharpening levels in a highsharpening level range at pixel locations associated with skinprobability values in a low skin probability range. This type ofsharpening satisfies the typical desire to aggressively sharpennon-human-skin toned features (e.g., eyes, lips, hairline, trees, andgrass) inside and outside human faces.

The sharpening parameter values that are computed by the controlparameter module 20 also are configured to cause the image enhancementmodule 22 to sharpen the input image with sharpening levels in a lowsharpening level range at pixel locations associated with skinprobability values in a high skin probability range and face probabilityvalues in a high face probability range. In this case, the lowsharpening level range is below the high sharpening level range and thehigh skin probability range is above the low skin probability range.This type of sharpening satisfies the typical desire to lessaggressively sharpen (or not sharpen at all) human-skin toned featureswithin human faces.

The sharpening parameter values that are computed by the controlparameter module 20 also are configured to cause the image enhancementmodule 22 to sharpen the input image 24 with sharpening levels in anintermediate sharpening level range at pixel locations associated withskin probability values in the high skin probability range and faceprobability values in a low face probability range. In this case, theintermediate sharpening level range is between the high and lowsharpening level ranges, and the low face probability range is below thehigh face probability range. This type of sharpening gives flexibilityin sharpening features outside of human faces. For these pixels, thedecision of whether or not to sharpen human-skin toned features isunclear because these features may be features, such as autumn leavesand dry grass, which observers typically want to appear sharp and crispor they may be features, such as a missed human face or other human skincontent, which observers typically do not want sharpened.

FIG. 9 shows an embodiment of a method in accordance with which thecontrol parameter module 20 computes a sharpening factor map thatcontains for each pixel of the input image 24 a respective sharpeningfactor that controls the sharpening levels applied by the imageenhancement module 22 in the manner described in the precedingparagraphs. In this embodiment, the control parameter module 20determines the sharpening factor map (FIG. 9, block 64), determines aglobal sharpening parameter (FIG. 9, block 66), and generates pixelsharpening parameters from a combination of the sharpening factor mapand the global sharpening parameter value (FIG. 9, block 68).

In some of the embodiments in accordance with the method of FIG. 9, thesharpening factors g(f(x,y),s(x,y)) are computed in accordance withequation (5):

$\begin{matrix}{{g\left( {{f\left( {x,y} \right)},{s\left( {x,y} \right)}} \right)} = {1 - {\frac{\left( {1 + {f\left( {x,y} \right)}} \right)}{2} \cdot \left\{ \begin{matrix}0 & {{{if}\mspace{14mu}{s\left( {x,y} \right)}} < {{Lth}\left( {f\left( {x,y} \right)} \right)}} \\1 & {{{if}\mspace{14mu}{s\left( {x,y} \right)}} > {{Hth}\left( {f\left( {x,y} \right)} \right)}} \\\frac{\left( {{s\left( {x,y} \right)} - {{Lth}\left( {f\left( {x,y} \right)} \right)}} \right)}{{{Hth}\left( {f\left( {x,y} \right)} \right)} - {{Lth}\left( {f\left( {x,y} \right)} \right.}} & {Otherwise}\end{matrix} \right.}}} & (5)\end{matrix}$where f(x,y) is the face map probability for pixel (x,y), s(x,y) is theskin map probability for pixel (x,y), Lth(f(x,y)) is a lower skinprobability threshold, and Hth(f(x,y)) is an upper skin probabilitythreshold. In general, both Lth(f(x,y)) and Hth(f(x,y)) may varydepending on face probability values.

In some embodiments, the upper skin threshold is set to an empiricallydetermined constant value. In one exemplary embodiment, the upper skinthreshold is set of 0.69. In some embodiments, the sharpening offeatures in detected faces (e.g. eyes, lips etc) is lower than thesharpening of details outside of the detected faces (e.g. trees andbuildings). In some of these embodiments, the adaptive sharpening isimplemented by Hth(f(x,y))=a_(H)+b_(H)·f(x,y). In one embodiment,a_(H)=0.6836 and b_(H)=0. In another embodiment, a_(H)=0.6836 andb_(H)=−0.03.

In some embodiments, the lower skin threshold Lth(f(x,y)) is adecreasing function of the face probability value f(x,y), which adaptsthe lower skin threshold to more conservatively sharpening of facialpixels. In some of these embodiments, the lower skin threshold is giveby:Lth(f(x,y))=a−b·f(x,y)  (6)where a and b are empirically determined positive-valued constants. Inone exemplary embodiment, a=0.61 and b=−0.008.

FIG. 10 shows an example of a sharpening factor map 70 that is generatedby the control parameter module 20 from the face map 60 shown in FIG. 6and the skin map 62 shown in FIG. 8 in accordance with the sharpeningfactor generation process described above in connection with equations(5) and (6).

In some embodiments the sharpening factor values in the sharpeningfactor map are combined with a global sharpening parameter, which isused to control or tune the sharpening levels that are applied to thepixels of the input image 24 to produce the enhanced image 26. Thesharpening enhancement process to be tuned may be, for example, any typeof spatial sharpening filter, including but not limited to anunsharp-masking filter, a high-pass filter, a high boost filter, adifferences of Gaussians based filter, and a Laplacian of Gaussianfilter.

In some embodiments, the image enhancement process to be tuned is anon-linear smoothing and sharpening filter that combines bilateralfiltering and generalized unsharp-masking. This filter may be derivedfrom a low pass filter of the type defined in equation (7):

$\begin{matrix}{{{Out}\left( {x,y} \right)} = {\sum\limits_{ij}{K_{ij} \cdot {{In}\left( {{x - i},{y - j}} \right)}}}} & (7)\end{matrix}$where (x,y) specifies the coordinate locations of the pixels and thekernel is designed such that

${\sum\limits_{ij}K_{ij}} = 1.$In particular, the low-pass filter defined in equation (7) may bere-written as

$\begin{matrix}{{{Out}\;\left( {x,y} \right)} = {{{In}\left( {x,y} \right)} + {\sum\limits_{ij}{K_{ij} \cdot \left( {{{In}\left( {{x - i},{y - j}} \right)} - {{In}\left( {x,y} \right)}} \right)}}}} & (8)\end{matrix}$The corresponding bilateral filter is given by equation (9):

$\begin{matrix}{{{Out}\;\left( {x,y} \right)} = {{{In}\left( {x,y} \right)} + {\sum\limits_{ij}{K_{ij} \cdot {\psi\left( {{{In}\left( {{x - i},{y - j}} \right)} - {{In}\left( {x,y} \right)}} \right)}}}}} & (9)\end{matrix}$where the function ψ(z=In(x−i,y−j)−In(x,y)) usually a non-linearfunction. Note that if ψ(z)=z, equation (9) becomes equation (8).Similarly if ψ(z)=−λ·z, equation (9) becomes

$\begin{matrix}{{{Out}\;\left( {x,y} \right)} = {{\left( {1 + \lambda} \right) \cdot {{In}\left( {x,y} \right)}} - {\lambda{\sum\limits_{ij}{K_{ij} \cdot {{In}\left( {{x - i},{y - j}} \right)}}}}}} & (10)\end{matrix}$which is a linear unsharp mask convolution filter in which λ is asharpness parameter. In the illustrated embodiments, the imageenhancement module 22 sharpens the input image in accordance withequation (9) and equation (11), which defines ψ(z) as follows:

$\begin{matrix}{{\psi(z)} = {R \cdot \left\{ \begin{matrix}z & {{z} < {Th}} \\{{{sign}\;{(z) \cdot {Th}}} + {\lambda \cdot \left( {{Th} - z} \right)}} & {otherwise}\end{matrix} \right.}} & (11)\end{matrix}$In equation (11), Th is a noise threshold that determines the localdeviation level that will be smoothed (should be high in case of strongnoise). The sharpness parameter λ determines the extent of sharpnessthat is introduced into significant edges (higher values result insharper images). The parameter R is a radicality parameter thatdetermines how radical the enhancement should be: when R=1, the otherparameters operate at their nominal values; when R=0, the output equalsthe input; when 0<R<1, the output is a weighted average between thesetwo extremes.

In some embodiments, the noise threshold Th_(NOMINAL) is given byequation (12):

$\begin{matrix}{{Th}_{NOMINAL} = \left\{ \begin{matrix}{4 \cdot N^{S}} & {N^{S} < 3} \\12 & {3 \leq N^{S}}\end{matrix} \right.} & (12)\end{matrix}$where the noise attribute N^(S) is estimated as the mean absolutehigh-pass content (HP(x)) over S, as defined in equation (13):

$\begin{matrix}{N^{S} = {\int_{z \in S}{{{{HP}(z)}}{\mathbb{d}z}}}} & (13)\end{matrix}$In some embodiments, the smooth scene regions (S) are defined as regionswith consistently low LP(z) activity (i.e., the values of LP(z) in thesmooth region and its V-vicinity are lower than a threshold Tsm).Highlights and shadows are excluded from S due to possible tonesaturation, which might introduce textures into S. That is,S={t|(G ^(H) >In(t)>G ^(L)) and {∀x ε[t−V,t+V], LP(z)<T _(sm)}}  (14)

Additional details regarding the estimation of the noise attribute N^(S)can be found in application Ser. No. 11/388,152, which was filed on Mar.22, 2006, and is incorporated herein by reference. In some embodiments,the sharpness parameter λ is calculated in accordance with equation(15):λ=λ_(GLOBAL) ·g(f(x,y),s(x,y))  (15)where g(f(x,y),s(x,y)) is defined in equation (5) and λ_(GLOBAL) is aglobal sharpening parameter that is given by equation (16):

$\begin{matrix}{\lambda_{GLOBAL} = \left\{ \begin{matrix}2.5 & {{Sh}^{F} < 0.1} \\{2.5 - {7.5*\left( {{Sh}^{F} - 0.1} \right)}} & {0.1 \leq {Sh}^{F} < 0.3} \\1 & {0.3 \leq {Sh}^{F}}\end{matrix} \right.} & (16)\end{matrix}$where Sh^(F) is a sharpness measure. In some embodiments, the sharpnessmeasure is determined in accordance with the method described inapplication Ser. No. 10/835,910, which was filed on Apr. 29, 2004, andis incorporated herein by reference. In other embodiments, the sharpnessmeasure amounts to averaging frequency band ratios over regions morelikely to be sharp edges. In some of these embodiments, the sharpnessmeasure is estimated by equation (17):

$\begin{matrix}{{Sh}^{F} = {\int_{z \in F}{\left( \frac{{HP}(z)}{{LP}(z)} \right)^{2}{\mathbb{d}z}}}} & (17)\end{matrix}$where F is a feature region characterized by a threshold T_(sh) in thelocal low-pass feature, as defined in equation (18):F={z|LP(z)>T _(sh)}  (18)

The global sharpening parameter (λ_(GLOBAL)), which is computed for eachinput image, takes into account the different levels of quality in eachimage. Thus, with respect to two different images that describe the samescene but differ in quality (e.g., one noisy and one clean, or one sharpand one blurry), the sharpness parameter λ will be different, even ifthe skin and face values are the same.

2. Contrast-Enhancing the Input Image

The embodiments that are described in detail below are configured toperform face-sensitive contrast enhancement of the input image. Ingeneral, the contrast enhancement may be performed instead or inaddition to the sharpening enhancement described in the precedingsection.

FIG. 11 shows an embodiment 72 of the image enhancement system 10 inwhich one of the other attribute extraction modules 18 is a tone maskextraction module 74, and the image enhancement module 22 includes atone mapping module 76 and a enhanced image generator 78.

FIG. 12 shows an embodiment of a method in accordance with which thecontrol parameter module 20 and the image enhancement module 22cooperatively enhance the input image 24 to produce the enhanced image26.

The control parameter module 20 ascertains a facial content measurementvalue indicating a degree to which the input image 24 contains humanface content (FIG. 12, block 80). In general, the control parametermodule 20 may ascertain the facial content measurement value in any of awide variety of different ways. In some embodiments, the controlparameter module 20 ascertains the facial measurement value bycalculating the average of the values in the face map that is generatedby the face map module 14. The resulting average value represents anestimate of the proportion of the input image 24 occupied by facialcontent.

The control parameter module 20 then tunes a tone-correction process inaccordance with the facial content measurement value (FIG. 12, block82). In some embodiments, the control parameter module 20 determines aweight that is used by the image enhancement module 22 to control theamount of an image-dependent (though not necessarily face-sensitive)default contrast enhancement 86 that should be applied to the inputimage 24. In the illustrated embodiments, the amount of the applieddefault contrast enhancement decreases with the value of the weightdetermined by the control parameter value. In general, the weight may beany function that maps facial content measurement values Γ to weightvalues ν(Γ). In general, the weight values may take on any positive ornegative value. In one exemplary embodiment, the weight function (ν(Γ))is given by equation (19):

$\begin{matrix}{{\upsilon(\Gamma)} = \left\{ \begin{matrix}1 & {{{if}\mspace{14mu}\Gamma} > \theta_{F}} \\0 & {{{if}\mspace{14mu}\Gamma} \leq \theta_{F}}\end{matrix} \right.} & (19)\end{matrix}$where θ_(F) is an empirically determined threshold. In some exemplaryembodiments θ_(F)=0.15.

The image enhancement module 22 enhances the input image 24 with animage-dependent default tone mapping module 76 that depends on a tonemask 77 that is extracted by the tone extraction module 74. The enhancedimage generator 78 then enhances the input image 24 based on theimage-dependent weight received from the control parameter module 20 andthe tone-corrected pixel values received from the tone mapping module76.

The tone mask extraction module 74 generates a tone mask of the inputimage 24. In some embodiments, the tone mask extraction module 74generates the tone mask by performing an iterative operation on theinput image 74. For instance, some embodiments generate the tone mask byusing an iterative process (such as a Retinex process) that makesassumptions about the human visual system. Other embodiments generatethis mask by performing a non-iterative operation on the input image 74.For example, some embodiments perform a low-pass filtering operation onthe input image 74 to generate the tone mask (see, e.g., the embodimentdescribed in connection with FIG. 2 of U.S. Pat. No. 6,813,041).

The tone mapping module 76 modifies the pixel color values in the inputimage 24 through linear or non-linear combinations of the tone maskvalues and the pixel color values in the input image 24. In otherembodiments, the tone mapping module 76 modifies the pixel color valuesin the input image 24 non-linearly. Among the types of non-linearoperations that may be used to modify the input image pixel color valuesare rotated scaled sinusoidal functions, sigmoidal functions, andexponential functions that have input image pixel color values as partof their base (see, e.g., the embodiment described in connection withFIG. 3 of U.S. Pat. No. 6,813,041).

The enhanced image generator 78 enhances the input image 24 based on theface-sensitive weight received from the control parameter module 20 andthe tone-corrected pixel values received from the tone mapping module76. In some exemplary embodiments, the enhanced image generator 78calculates the values of the enhanced image pixels from a weightedcombination of the values of the input image pixels and the values(T(x,y)) of the tone-corrected pixels 86 in accordance with equation(20):Out(x,y)=ν(Γ)·T(x,y)+(1−ν(Γ))·In(x,y)   (20)

III. Exemplary Architectures of the Image Processing Systems

Embodiments of the image enhancement system 10 (including the embodiment72 shown in FIG. 11) may be implemented by one or more discrete modules(or data processing components) that are not limited to any particularhardware, firmware, or software configuration. In the illustratedembodiments, the modules of the image enhancement system 10 may beimplemented in any computing or data processing environment, includingin digital electronic circuitry (e.g., an application-specificintegrated circuit, such as a digital signal processor (DSP)) or incomputer hardware, firmware, device driver, or software. In someembodiments, the functionalities of the modules of the image enhancementsystem 10 are combined into a single data processing component. In someembodiments, the respective functionalities of each of one or more ofthe modules of the image enhancement system 10 are performed by arespective set of multiple data processing components.

In some implementations, process instructions (e.g., machine-readablecode, such as computer software) for implementing the methods that areexecuted by the embodiments of the image enhancement system 10, as wellas the data it generates, are stored in one or more machine-readablemedia. Storage devices suitable for tangibly embodying theseinstructions and data include all forms of non-volatilecomputer-readable memory, including, for example, semiconductor memorydevices, such as EPROM, EEPROM, and flash memory devices, magnetic diskssuch as internal hard disks and removable hard disks, magneto-opticaldisks, DVD-ROM/RAM, and CD-ROM/RAM.

In general, embodiments of the image enhancement system 10 may beimplemented in any one of a wide variety of electronic devices,including desktop and workstation computers, television monitors,projection displays, or video cards connected to such large screensdisplays, video recording devices (e.g., VCRs and DVRs), cable orsatellite set-top boxes capable of decoding and playing paid videoprogramming, and digital camera devices. Due to its efficient use ofprocessing and memory resources, some embodiments of the imageenhancement system 10 may be implemented with relatively small andinexpensive components that have modest processing power and modestmemory capacity. As a result, these embodiments are highly suitable forincorporation in application environments that have significant size,processing, and memory constraints, including but not limited toprinters, handheld electronic devices (e.g., a mobile telephone, acordless telephone, a portable memory device such as a smart card, apersonal digital assistant (PDA), a solid state digital audio player, aCD player, an MCD player, a game controller, a pager, and a miniaturestill image or video camera), digital cameras, and other embeddedenvironments.

FIG. 13 shows an embodiment of a computer system 140 that incorporatesan embodiment of the image enhancement system 10. The computer system140 may be implemented by a standalone computer (e.g., a desktopcomputer, workstation computer, or a portable computer) or it may beincorporated in another electronic device (e.g., a printer or a digitalcamera). The computer system 140 includes a processing unit 142 (CPU), asystem memory 144, and a system bus 146 that couples processing unit 142to the various components of the computer system 140. The processingunit 142 typically includes one or more processors, each of which may bein the form of any one of various commercially available processors. Thesystem memory 144 typically includes a read only memory (ROM) thatstores a basic input/output system (BIOS) that contains start-uproutines for the computer system 140 and a random access memory (RAM).The system bus 146 may be a memory bus, a peripheral bus or a local bus,and may be compatible with any of a variety of bus protocols, includingPCI, VESA, Microchannel, ISA, and EISA. The computer system 140 alsoincludes a persistent storage memory 148 (e.g., a hard drive, a floppydrive, a CD ROM drive, magnetic tape drives, flash memory devices, anddigital video disks) that is connected to the system bus 146 andcontains one or more computer-readable media disks that providenon-volatile or persistent storage for data, data structures andcomputer-executable instructions.

A user may interact (e.g., enter commands or data) with the computersystem 140 using one or more input devices 150 (e.g., a keyboard, acomputer mouse, a microphone, joystick, and touch pad). Information maybe presented through a graphical user interface (GUI) that is displayedto the user on a display monitor 152, which is controlled by a displaycontroller 154. The computer system 140 also typically includesperipheral output devices, such as speakers and a printer. One or moreremote computers may be connected to the computer system 140 through anetwork interface card (NIC) 156.

As shown in FIG. 13, the system memory 144 also stores an embodiment ofthe image enhancement system 10, a GUI driver 158, and a database 160containing image files corresponding to the input and enhancement images24, 26, intermediate processing data, and output data. In someembodiments, the image enhancement system 10 interfaces with the GUIdriver 158 and the user input 150 to control the creation of theenhanced image 26. In some embodiments, the computer system 140additionally includes a graphics application program that is configuredto render image data on the display monitor 152 and to perform variousimage processing operations on the enhanced image 26.

IV. Conclusion

The embodiments that are described in detail herein are capable ofenhancing images in face and skin sensitive ways. At least some of theseembodiments enhance images in ways that avoid artifacts and otherundesirable problems that arise as a result of enhancing an image basedon segmentations of the image into discrete subject matter regions. Atleast some of these embodiments are capable of adjusting default controlparameters in image-dependent ways.

Other embodiments are within the scope of the claims. For example, insome embodiments, a sequence of images (e.g., a sequence of videoframes) may be processed by the image processing system 10. In some ofthese embodiments, a respective face map and a respective skin map arecalculated for each of the images in the sequence in accordance with themethods described above.

1. A method, comprising: calculating a face map comprising for eachpixel of an input image a respective face probability value indicating adegree to which the pixel corresponds to a human face, whereinvariations in the face probability values are continuous across the facemap; ascertaining a skin map comprising for each pixel of the inputimage a respective skin probability value indicating a degree to whichthe pixel corresponds to human skin; and enhancing the input image withan enhancement level that varies pixel-by-pixel in accordance with therespective face probability values and the respective skin probabilityvalues; wherein the calculating, the ascertaining, and the enhancing areperformed by a computer system.
 2. The method of claim 1, wherein thecalculating comprises: processing patches of the input image through acascade of classifiers, wherein each patch is processed through arespective number of the classifiers depending on a per-classifierevaluation of the likelihood that the patch corresponds to a human face;and calculating the face probability values for the pixels of the inputimage in accordance with the respective numbers of classifiers throughwhich corresponding ones of the patches were processed.
 3. The method ofclaim 2, wherein the calculating comprises processing each of thepatches through at least two parallel classifier cascades that areconfigured to evaluate different respective facial views.
 4. The methodof claim 3, wherein the calculating comprises determining the faceprobability values from the respective numbers of classifiers of eachcascade through which corresponding ones of the patches were evaluated.5. The method of claim 1, wherein the ascertaining comprisesascertaining per-pixel skin tone probabilities from skin toneprobability distributions in respective channels of a color space. 6.The method of claim 1, wherein the enhancing comprises sharpening theinput image with a sharpening level that varies pixel-by-pixel inaccordance with the respective face probability values and therespective skin probability values.
 7. The method of claim 6, whereinthe sharpening comprises: sharpening the input image with sharpeninglevels in a high sharpening level range at pixel locations associatedwith skin probability values in a low skin probability range; sharpeningthe input image with sharpening levels in a low sharpening level rangeat pixel locations associated with skin probability values in a highskin probability range and face probability values in a high faceprobability range, the low sharpening level range being below the highsharpening level range and the high skin probability range being abovethe low skin probability range; and sharpening the input image withsharpening levels in an intermediate sharpening level range at pixellocations associated with skin probability values in the high skinprobability range and face probability values in a low face probabilityrange, the intermediate sharpening level range being between the highand low sharpening level ranges and the low face probability range beingbelow the high face probability range.
 8. The method of claim 1, furthercomprising, for each pixel of the input image, determining a respectivecontrol parameter value from the respective face probability value andthe respective skin probability value.
 9. The method of claim 8, whereinthe determining is performed without regard to any classification of theface map into one or more regions of human face content and withoutregard to any classification of the skin map into one or more regions ofhuman skin content.
 10. The method of claim 8, wherein the determiningcomprises determining for each pixel of the input image a respectivesharpening parameter value from the respective face probability valueand the respective skin probability value, and the enhancing comprisessharpening the input image with a sharpening level that variespixel-by-pixel in accordance with the respective control parametervalues.
 11. The method of claim 8, wherein the determining comprisesinputting the face probability values and the skin probability valuesinto a continuous function that maps each pair of corresponding face andskin probability values to a respective sharpening parameter.
 12. Themethod of claim 1, wherein the enhancing comprises determining one ormore control parameter values in accordance with one or more imageenhancement processes, and modifying the one or more control parametervalues in accordance with the respective face probability values and therespective skin probability values.
 13. The method of claim 1, furthercomprising determining a global control parameter value based on globalfeatures of the input image and determining for each pixel of the inputimage a respective local control parameter value that corresponds to arespective modification of the global parameter value in accordance withthe respective face probability values and the respective skinprobability values, wherein the enhancing comprises enhancing the inputimage in accordance with the local control parameter values.
 14. Themethod of claim 1, further comprising estimating from the face map afacial content measurement value indicating a degree to which the inputimage contains human face content, wherein the enhancing comprisestuning a tone-correction process in accordance with the facial contentmeasurement value.
 15. The method of claim 14, wherein the tuningcomprises controlling a contribution of a default tone-corrected imageto an output tone-corrected image based on the facial contentmeasurement value, wherein the default tone-corrected image is derivedfrom input pixel values entered into the tone-correction process. 16.The method of claim 15, wherein the enhancing comprises determining atleast one weight from the facial content measurement value, andcalculating a weighted combination of the default tone-corrected imageand the input pixel values in accordance with the at least one weight.17. A method, comprising: ascertaining a facial content measurementvalue indicating a degree to which an input image contains human facecontent, wherein the ascertaining comprises determining the facialcontent measurement value from a determined proportion of the inputimage that is occupied by facial content; tuning a tone-correctionprocess in accordance with the facial content measurement value; andenhancing the input image in accordance with the tuned tone-correctionprocess; wherein the calculating, the ascertaining, and the enhancingare performed by a computer system.
 18. The method of claim 17, furthercomprising deriving a default tone-corrected image from input pixelvalues entered into a tone-correction process, wherein the tuningcomprises controlling a contribution of the default tone-corrected imageto an output tone-corrected image based on the facial contentmeasurement value.
 19. A method, comprising: ascertaining a facialcontent measurement value indicating a degree to which an input imagecontains human face content; deriving a default tone-corrected imagefrom input pixel values entered into a tone-correction process; tuning atone-correction process in accordance with the facial contentmeasurement value, wherein the tuning comprises controlling acontribution of the default tone-corrected image to an outputtone-corrected image based on the facial content measurement value; andenhancing the input image in accordance with the tuned tone-correctionprocess, wherein the enhancing comprises determining at least one weightfrom the facial content measurement value, and calculating a weightedcombination of the default tone-corrected image and the input pixelvalues in accordance with the at least one weight.
 20. The method ofclaim 19, wherein the determining comprises applying a minimum facialcontent threshold to the facial content measurement value and settingthe at least one weight such that the contribution of the defaulttone-corrected image is reduced in response to a determination that thefacial content measurement value meets the minimum facial contentthreshold.
 21. A system, comprising: a memory storing processor-readableinstructions; a processor coupled to the memory, operable to execute theinstructions, and based at least in part on the execution of theinstructions operable to perform operations comprising calculating aface map comprising for each pixel of an input image a respective faceprobability value indicating a degree to which the pixel corresponds toa human face, wherein variations in the face probability values arecontinuous across the face map; ascertaining a skin map comprising foreach pixel of the input image a respective skin probability valueindicating a degree to which the pixel corresponds to human skin; andenhancing the input image with an enhancement level that variespixel-by-pixel in accordance with the respective face probability valuesand the respective skin probability values.
 22. The system of claim 21,wherein, based at least in part on the execution of the instructions theprocessor is operable to perform operations comprising determining, foreach pixel of the input image, a respective control parameter value fromthe respective face probability value and the respective skinprobability value, wherein the control parameter module determines therespective control parameter values without regard to any classificationof the face map into one or more regions of human face content andwithout regard to any classification of the skin map into one or moreregions of human skin content.
 23. The system of claim 21, wherein basedat least in part on the execution of the instructions the processor isoperable to perform operations comprising determining one or morecontrol parameter values in accordance with one or more imageenhancement processes, and modifies the one or more control parametervalues in accordance with the respective face probability values and therespective skin probability values.
 24. The system of claim 21, wherein,based at least in part on the execution of the instructions theprocessor is operable to perform operations comprising estimating fromthe face map a facial content measurement value indicating a degree towhich the input image contains human face content, and the imageenhancement module tunes a tone-correction process in accordance withthe facial content measurement value.
 25. A system, comprising: a memorystoring processor-readable instructions; a processor coupled to thememory, operable to execute the instructions, and based at least in parton the execution of the instructions operable to perform operationscomprising ascertaining a facial content measurement value indicating adegree to which an input image contains human face content, wherein theascertaining comprises determining the facial content measurement valuefrom a determined proportion of the input image that is occupied byfacial content; tuning a tone-correction process in accordance with thefacial content measurement value; and enhancing the input image inaccordance with the tuned tone-correction process.
 26. The system ofclaim 25, wherein, based at least in part on the execution of theinstructions the processor is operable to perform operations comprisingderiving a default tone-corrected image from input pixel values enteredinto a tone-correction process, wherein the tuning comprises controllinga contribution of the default tone-corrected image to an outputtone-corrected image based on the facial content measurement value. 27.A non-transitory machine readable medium storing machine-readableinstructions causing a machine to perform operations comprising:calculating a face map comprising for each pixel of an input image arespective face probability value indicating a degree to which the pixelcorresponds to a human face, wherein variations in the face probabilityvalues are continuous across the face map; ascertaining a skin mapcomprising for each pixel of the input image a respective skinprobability value indicating a degree to which the pixel corresponds tohuman skin; and enhancing the input image with an enhancement level thatvaries pixel-by-pixel in accordance with the respective face probabilityvalues and the respective skin probability values.
 28. A non-transitorymachine readable medium storing machine-readable instructions causing amachine to perform operations comprising, comprising: ascertaining afacial content measurement value indicating a degree to which an inputimage contains human face content, wherein the ascertaining comprisesdetermining the facial content measurement value from a determinedproportion of the input image that is occupied by facial content; tuninga tone-correction process in accordance with the facial contentmeasurement value; and enhancing the input image in accordance with thetuned tone-correction process.
 29. The method of claim 1, wherein theascertaining comprises mapping the pixels of the input image torespective skin probability values in the skin map independently ofpositions of the pixels in the input image.